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We introduce a new method for estimating determinants or determinant ratios of large matrices, which combines 
the techniques of Pade approximation with rational functions and Zi noise estimation of traces of large matrices. 
The method requires simultaneously solving several matrix equations, which can be conveniently accomplished 
using the MR method. We include some preliinary results, and indicate potential applications to non-Hermitian 
matrices, and Hybrid Monte Carlo without pseudofermions. 



1. Introduction 

The current work was motivated by our search 
for an alternative implementation of the Hybrid 
Monte Carlo (HMC) algorithm in Lattice QCD 
which does not require the use of pseudofermions 
Our proposed algorithm (which is described in 
more detail in [[lj requires the estimation of deter- 
minant ratios det Mi/ det M2 where the matri- 
ces Mi and M2 satisfy the following conditions: 
Mi and M 2 are huge (N x N, where N ~ 10 6 ); 
the eigenvalues of Mi and M 2 have positive real 
parts; log(detMi) are 0(N), but detMi/rfeiM 2 
is O(l); and the eigenvalues of M 2 are continuous 
perturbations of the eigenvalues of Mi. 

In this paper we present a new method for 
estimating such determinant ratios, which takes 
advantage of Pade approximation and Zi noise 
vectors (hence the acronym 'PZ'). The potential 
application of related methods to estimating the 
density of states, is also indicated. 

2. Outline of the PZ Method 

Our improved algorithm is based on the ap- 
proximation of log A with a rational function via 
the use of Pade approximants. The Pade approx- 
imation to log(z) of order [J, J] at z is a rational 
function N(z)/D(z) where degA^(z) = degD(z) = 
J, whose value and first 2 J derivatives agree with 
logz at the specified point Zq. When the Pade ap- 
proximation is expressed in partial fractions, we 
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obtain 

J 

logM^aoI + ^a^M + fc,)- 1 , (1) 
i=i 

which implies 

log{detMi/<feiM 2 } = Tr [log Mi - logM 2 ] 
j 

= a i {Tr(M 1 + bj)- 1 - Tr(M 2 + b,)- 1 } . (2) 
j'=i 

The traces of inverse matrices (M + bj)~ 1 may 
then be found using the Z 2 noise method [0 , and 
it follows 

Tr [log Ma - logM 2 ] » 

U 

where {r]i, I = 1, . . . , L} are complex Z 2 noise vec- 

(k) 

tors, and the ^ / are vectors defined by: 

$ = (M k + bji)- l m. (4) 

3. Advantages of the PZ method 

The PZ method takes advantage of proven, 
effective numerical approximation techniques. 
Pade approximation uses rational functions, 
which are very efficient when it comes to uniform 
approximation of analytic functions: for exam- 
ple, an [11,11] Pade expansion of logz around 
zq = .1 is accurate to within 10~ 7 on the interval 
[.004,2.5]. In our application, the Pade approx- 
imation to the logarithm only needs to be accu- 
rate on the region in the complex plane where the 
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spectra of M x and M 2 differ. Also, complex Z 2 
random vectors have been shown to be superior to 
Gaussian in computing traces of inverse matrices. 

The PZ method is also in a position to take 
advantage of recent results on efficient solution 
of linear problems with multiple diagonal shifts. 
The column inversions in | for fixed I, k may be 
performed using GMRES with multiquarks in the 
same computational time it takes to solve just 
one-only more memory is required (an additional 
vector for each j) |J. This can lead to a consid- 
erable speedup in the algorithm. Hence, a higher 
order Pade expansion requires more memory, but 
the same computation time (apart from matrix 
conditioning effects, see next paragraph). The 
multi-quark GMRES method can be applied to 
non-Hermitian matrices: so determinants of non- 
Hermitian matrices may also be found directly, 
without recourse to the Hermitian matrix M^M. 

The bj's turn out to have positive real parts, 
and negligable imaginary parts: thus the matrices 
M + bjl are better- conditioned than M, and the 
column inversions should be faster. 

However, this effect diminishes for higher order 
Pade approximations, because the real parts of 
some terms become smaller. 

The PZ method also holds promise of being 
useful in the case where different quark flavors are 
present, in which case it is necessary to compute 

det{(M 1 + Ml )(M 1 +/x 2 )} 
det{(M 2 + Ml )(M 2 +M2)} 1 ' 

Using multi-quark GMRES, this takes the same 
amount of computation as a single determinant 
ratio. 

4. Numerical Results 

Figure 1 shows the result of numerical experi- 
ments involving the matrix Mi associated with 
a typical (heatbath-generated) quenched gauge 
configuration on a f6 3 x 24 lattice with (3 = 6.0, 
k = 0.f54, and the matrix M 2 generated from 
Mi by updating 20 links in a heatbath. The 
PZ estimates of log | det Mi/ det M 2 | using a [5, 5] 
Pade approximation with up to 50 Z 2 noise vec- 
tors is shown in Figure 1, and the jackknife error 
is shown in Figure 2. The PZ estimate of the 



real part of Zog(detMi) (using (1) with an addi- 

(21 

tional term aoN and Q { = 0) is shown in Fig- 
ure 3, while the corresponding jackknife errors are 
shown in Figure 4. The PZ estimate of the imag- 
inary part of Zog(detMi) is shown in Figure 5 
(the actual value is 0). 

These results demonstrate that the PZ method 
leads to controlled error in determinant ratios af- 
ter a relatively small number of column inver- 
sions. 



The value of ln(detM_1/detM_2)=-0. 26(41) 
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Figure 1. PZ estimates of determinant ratio 



5. Numerical error and computation time 
in the PZ method 

There are three sources of numerical error in 
the PZ method: Pade approximation; Z 2 esti- 
mation; and column inversion via GMRES. The 
Pade error can be virtually eliminated by taking 
more terms in the Pade expansion, which requires 
more memory but not more computation time. A 
theoretical expression for the Z 2 error is 

Var(7YA - Trrf Ar,) = \Y j \\Mj\\ 2 - (6) 

1*3 

The column inversion error is reduced by taking 
more iterations, at the cost of increased compu- 
tation time. 
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The jackknife error of ln(detM_1/detM_2) 
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Figure 2. Jackknife error for estimates in Figure 
1. 



The computation time depends on the number 
of noise vectors required to get a good trace esti- 
mate. If GMRES is used, each noise vector used 
gives rise to one column inversion. 

It should be mentioned that alternatives to 
Pade approximation have been proposed, includ- 
ing Chebyshev polynomials || and Stieltjes inte- 
grals ||. Numerical experiments should be per- 
formed to determine which is more efficient. 

6. Estimating the density of states 

Some of the ideas introduced above may be 
used to estimate the density of states p(X) as fol- 
lows. Any term of the form 



71— \ J 

= //« 2A xV w < 7 » 

can be used as a "probe" to sample spectral in- 
formation near the specified pole bj. Hence p(A) 
can be estimated via the following procedure: (1) 
Choose J complex numbers bj which are strate- 
gically placed around the support of p{\); (2) Es- 
timate Tj = Tr{(M — bj)^ 1 } using the noise 
method; (3) Specify a fitting form for p(A) us- 



The real part of ln(det(M_1 )) 
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Figure 3. PZ estimate of real part of log(det M). 



ing J parameters: p(X) ^2j =1 Pj<f>j(X); and (4) 
Find the parameters pj by solving the equations 

T, = ]Ti = lJ W / /M 2 A]^|. (8) 
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The jackknife error of real part of ln(det(M_1 )) 
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Figure 4. Jackknife error for estimates in Figure 
3. 



The imaginary part of ln(det(M_1)) 
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Figure 5. PZ estimate of imaginary part of 
log(detM). 



